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Abstract 

We examine information theory using the steady-state Boltzmann equation. In a nonequilibrium 
steady-state system under steady heat conduction, the thermodynamic quantities from information 
theory are calculated and compared with those from the steady-state Boltzmann equation. We 
have found that information theory is inconsistent with the steady-state Boltzmann equation. 
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I. INTRODUCTION 



The behaviors of gases in nonequihbrium states have received considerable attention 
from the standpoint of understanding the characteristics of nonequihbrium phenomena. The 
Boltzmann equation is widely accepted as one of the most reliable models for describing gases 
in nonequihbrium phenomena, so that various attempts have been conducted on solving the 
Boltzmann equation. Recently, we have derived the explicit velocity 

distribution function of the steady-state Boltzmann equation for hard-core molecules to 

n 

second order in density and temperature gradients by the Chapman- Enskog method. [8|] 

On the other hand, in the early 1960s, Zubarevj^, Q| has developed nonequihbrium 
statistical mechanics and obtained the general form of a nonequihbrium velocity distribution 
function with the aid of the maximum entropy principle. Thereafter the nonequihbrium 
velocity distribution function to first order has been derived by expanding the Zubarev form 
for the nonequihbrium velocity distribution function under some constraints. 

Jou and his coworkers have derived the nonequihbrium velocity distribution function 
to second order by expanding the Zubarev form for the nonequihbrium velocity distri- 
bution function to second order under the some constraints, which is called information 
theory, ll 13,Q 



15 
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, ^ Information theory has attracted interest in the development 
of a general framework for nonlinear nonequihbrium statistical mechanics. There is even a 
text book on information theory. Jou et al. have applied the velo city distribution func- 
tion from information theory to nonequihbrium dilute gases. ll^ llZ 13, II^, 12, ll^ ll^ 
There are also several applications of information theory to other microscopic theories, such 



as radiation 







21 
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24| . nonviscous gases 



25l . |26[ and chemically reacting gases 



Nettleton claimed that information theory provides a statistical mechanical basis of irre- 
versible processes and of extended thermodynamics which is consistent with the laws of 



thermodynamics. 



28| He has develo ped the maximum entropy formalism and applied it to 



zQlj Jle nas developed 
im. 



a dilute gas system. 

|2a, 120, ml laa 12^ 

I However, in the actual applications, it is not easy 
to examine the validity of information theory. In order to demonstrate the invalidity of 
information theory, it is necessary to find qualitative differences between information theory 
and the microscopic theories in the applications. In fact, though we have recently compared 
the effect of heat flux on the rate of chemical reaction calculated from information theory 
with those which we have calculated from kinetic theories, we have found no qualitative 
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differences among them.js^ We find no reports which conclude that information theory is 
not an appropriate theory to describe nonequilibrium phenomena. 

However, as was mentioned in refs. 13 and 19, more examinations of information theory 
should be carried out from the microscopic viewpoint to confirm whether there exists uni- 
versality in nonlinear nonequilibrium statistical mechanics. In the present paper, we check 
the validity of information theory from a kinetic view point: we examine whether informa- 
tion theory coincides with the steady-state Boltzmann equation, at least qualitatively, in a 
nonequilibrium steady state. 

Suppose a dilute gas system subject to a temperature gradient along the x-axis in a 
steady state whose velocity distribution function is expressed as / = /(x, v). We introduce 
five conserved quantities and a heat flux playing important roles in both information theory 
and the steady-state Boltzmann equation. We define the density: 



n{x) = J fdw, (1) 

and the temperature: 

^ ' ^ ' - ' fd^j, (2) 



2 J 2 

with m the mass of a molecule and k the Boltzmann constant. We assume no mean flow: 



mwfd'w = 0, (3) 

where denotes the zero vector. Furthermore, we define the heat flux: 

-^vjdw. (4) 

It should be emphasized that the heat flux calculated from eq.(@]) must be uniform in a 
steady state. Actually, in the case for the steady-state Boltzmann equation, its solubility 
conditions lead to the heat flux being constant to second order, 

The organization of this paper is as follows. We will introduce information theory in ^ITTl 
In § mil we will introduce the velocity distribution functions of the steady-state Boltzmann 
equation for both hard-core and Maxwell molecules to second order by the Chapman-Enskog 
method. In ^ IIVI we will apply the velocity distribution functions to a nonequilibrium steady- 
state system under steady heat conduction, and compare the results of thermodynamic 
quantities from information theory with those from the steady-state Boltzmann equation. 
Our discussion and conclusion are written in 5 M 



II. INFORMATION THEORY 

Let us introduce information theory proposed by Jou et a/, jl^. 
Zubarev form for the nonequihbrium velocity distribution function under a heat flux can be 
obtained by maximizing the nonequihbrium entropy, defined as 



13 



Q,Q,li2i. 



The 



S{x) 



-K 



f log fdv, 



(5) 



under the constraints of the density (H)) , the temperature , no mean flow Q and the heat 
flux (HI) which is now assumed to be uniform as well as nuT by contrast with the case for 

n 

the steady-state Boltzmann equation. [8|] Jou et al. have finally obtained the nonequihbrium 
velocity distribution function to second order in the heat flux by expanding the Zubarev's 
nonequihbrium velocity distribution function to second order as 



If mv' 



1 - 



4J. 



hriKT \2kT 



m 



Cr. 



2PkT 



2pKT 



with the scaled velocity c = (m/2KT)^/^v. Here Z is given by 



1 / 27r 
n \Pm 



1 + 



in order to normalize /. The parameter f3 is found to be 



(7) 



P 



1 



1 



(8) 



and has been used by Jou et al. to introduce ^ as a nonequihbrium temperature. From eq.( 



it is clear that the nonequihbrium temperature 6 is not identical with 



;he temperature T 



defined in eq.Q, and 9 is lower than T.Q ll^, 14, 3, ll2l, Ij4 12^ 122 

By expanding the velocity distribution function (jH)) to second order in J^, we obtain the 
expression for the modified velocity distribution function: 



3Jx ( Tim \ 1 



2mJl 



mJl 



(6) 



(9) 



with the local Maxwellian distribution function f^^^ = exp(— c ). Here n and 

T have been identified in eqs.(ITI) and (0). This modified velocity distribution function has 



been also obtained and used by Fort and Cukrowskijisl. Note that Sl{X) is the Sonine 
polynomial, (see, e.g. ref. 8) We have confirmed that the modified velocity distribution 
function still satisfies constraints (jH)) and (0}, while the corrections appearing in eqs.Q and 
(jH)) no longer appear in the density ([Q) and the temperature (j21) with the modified velocity 
distribution function expressed in eq.Q- We adopt this modified velocity distribution func- 
tion instead of the velocity distribution function shown in eq.® to calculate macroscopic 
quantities in this paper. This adoption is based on the fact that the corrections in eqs.(j7j) 



and (jHl) are not significant, although Jou et al 



. 3, Q, Q, 



15, 



16, 17 



believe that the 



correction appearing in eq.(jHI) has important physical meaning, (see also § IVjl 



III. KINETIC THEORY: THE STEADY-STATE BOLTZMANN EQUATION 

We introduce the velocity distribution function of the steady-state Boltzmann equation 
for hard-core molecules which we have derived in ref. 8 valid to second order in density and 
the temperature gradient. In a nonequilibrium steady-state system under the temperature 
gradient along it can be written as 

4096mJ^ ^v-^ ^. 3.^„, ox 
+ ^r!62.(2c^-cj-c^)r(r + l)5|(c2)]}, (10) 

r>0 

where the specific values for foi^, &or and fcor are found in Table HI Note that we show only 
the values for 7th Sonine approximation. j8| 

For our calculation of the macroscopic quantities, we also adopt the precise velocity dis- 
tribution function of the steady-state Boltzmann equation for Maxwell molecules to second 



order derived by Schamberg 35|. It becomes 



r=2,3 

+ ^'^2.(24 - - cl)T{r + \)Sl{c')]}, (11) 

r=l,2 ^ 

where the precise values for 6or and are written in Table |nj It should be mentioned that 
the first-order velocity distribution function in eq.()ll|) is identical with that for information 



theory shown in eq.®, while the second-order velocity distribution functions are different 
from each other. 



IV. TEST OF INFORMATION THEORY 

Now the velocity distribution functions to second order given in cqs.©, (fTUj) and (fTTj) 
shall be applied to the nonequilibrium steady-state system. Note that all the definitions of 
physical quantities in this paper are the same as those in ref. 8. 

To begin with, the pressure tensor in the nonequilibrium steady state Pij becomes 

P., = n.T (5., + A^/^) , (12) 

with the unit tensor 5ij and the numerical tensor components Ap shown in Table ITTTl Note 
that the off-diagonal components of Ap are zero and that Ap^ = Ap is satisfied. We have 
found that Ap for information theory is qualitatively different from those for the steady- 
state Boltzmann equation for both hard-core and Maxwell molecules: Pxx becomes larger 
than Pyy and Pzz for information theory 



c ai l 



14, hj, while Pxx becomes smaller than Pyy and 



Pzz for the steady-state Boltzmann equation for hard-core molecules, and no second-order 
corrections appear in Pij for the steady-state Boltzmann equation for Maxwell molecules. 

Each component of the kinetic temperature in the nonequilibrium steady state, i.e. Ti 
for i = x,y and z is also calculated as 

for i = x,y and z. Numerical values for the constants Aj; for i = x,y and z are given in 
Table IIIII Note that A^^ = ■ We find that A^j for information theory is qualitatively 
different from those for the steady-state Boltzmann equation for both hard-core and Maxwell 
molecules: Tx becomes larger than Ty and for information theory, while Tx becomes 
smaller than Ty and Tz for the steady-state Boltzmann equation for hard-core molecules, and 
no corrections appear in Ti for the steady-state Boltzmann equation for Maxwell molecules. 
The Shannon entropy in the nonequilibrium steady state becomes 



S{x) = —nnlog 



3 , mj2 



n 



\2ttkt) 

to second order with the numerical constant A5 written in Table UTTl It is found that As for 
information theory is identical to that obtained from the steady-state Boltzmann equation 



for Maxwell molecules, while it is slightly different from A5 calculated from the steady-state 
Boltzmann equation for hard-core molecules. This is because the correction term for the 
Shannon entropy is determined only by the first-order velocity distribution function, as was 
indicated in ref. 12. 



V. DISCUSSION AND CONCLUSION 

It is seen that the first-order velocity distribution functions for the steady-state Boltzmann 
equation for both hard-core and Maxwell molecules, i.e. the first-order terms in eqs. (jl(J|) 
and (fTTj). are consistent with that derived by expanding Zubarev's velocity distribution 
function . This consistency is attributed to the fact that a nonequilibrium correction 

in the nonequilibrium entropy should appear to even order of a nonequilibrium flux, e.g. 
6S oc —Jx, in order that the nonequilibrium entropy has a maximum at = 0, and that a 
thermodynamic force F = 86 S/ dJx which drives a nonequilibrium system towards the state 
of equilibrium is proportional to the nonequilibrium flux.j^^ This fact leads to a conclusion 
that the nonequilibrium entropy is not modified from the local equilibrium entropy to first 
order, and that the Shannon-type entropy is appropriate as the nonequilibrium entropy to 
first order. 

On the other hand, we have confirmed that both forms (jlUj) and (jllj) of the second- 
order velocity distribution functions differ from that suggested by information theoryjl^. 
Il3l. Il4 115I lla. I7I. Although Jou et al. have applied information theory to nonequilibrium 

TinnnTinnn 

dilute gases [131, [IJ, [151, [161, 117|, [181, 119||, we have found that information theory contra- 



dicts the steady-state Boltzmann equation: all the macroscopic quantities for information 
theory except for the Shannon entropy 5* in eq. lfT^ are qualitatively different from those 
for the steady-state Boltzmann equation for both hard-core and Maxwell molecules. These 
qualitative differences between information theory and the steady-state Boltzmann equa- 
tion still appear no matter which boundary condition is adopted. It is conjectured that the 
entropy defined in eq.® is not appropriate as the nonequilibrium entropy to second order. 



though the Shannon-type entrq 
any order 



e anannon-type entropy nas been widely i: 



las been widely used as the nonequilibrium entropy to 
We emphasize that it is probably the 



first time to find qualitative differences between information theory and nonequilibrium mi- 
croscopic theories and demonstrate that information theory is inconsistent with the nonequi- 
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librium microscopic theories. We can conclude that, though quite a few statistical physicists 



have believed the existence of a universal velocity distribution function in t 



11 



12 



13 



le noneq uilibrium 



29 



30 



31 



32 



steady state by maximizing the Shannon- type entropy 0,[l^ 
the universal velocity distribution function does not exist in the nonequilibrium steady state. 
It is also worth mentioning that, although information theory based on the Tsallis entropy 



has been also developed j32 



the general form of the velocity distribution function for 



information theory based on the Tsallis entropy^, 13 cannot be expanded even to first 
order because the expanded velocity distribution function diverges. 

We have also confirmed that, in all the macroscopic quantities calculated in the present 
paper, there are no differences between the results from the modified velocity distribution 
function given in eq.ijH)) and those from Jou's velocity distribution function shown in eq.® 
so long as the same boundary condition is adopted. This suggests that the nonequilibrium 
temperature 6 has no physical significance. We emphasize that the identifications of the 
density, the temperature and the mean flow ( see eqs.(ll), (12) and (13) in ref. 8) do 
not affect the physical properties of the velocity distribution function for the steady-state 
Boltzmann equation^], and that those identifications must be satisfied for the conservation 
laws in the case for the steady-state Bhatnagar-Gross-Krook(BGK) equation. 0, 
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TABLE I: Numerical constants bir, bor and b2r in ea. (|lUj) . All the values are ones for 7th Sonine 
approximation . 





blr 


bor 


b2r 








1 


-3.320 X 10-2 


1 


L025 





-1.276 X 10-1 


2 


4.892 X 10-2 


4.380 X 10-1 


6.414 X 10-2 


3 


3.715 X 10-3 


-5.429 X 10-2 


5.521 X 10-3 


4 


2.922 X 10-"^ 


-4.098 X 10-3 


4.214 X 10-^ 


5 


2.187 X 10-^ 


-3.184 X 10-^ 


3.106 X 10-^ 


6 


1.492 X 10-^ 


-2.087 X 10-^ 


1.861 X 10-6 


7 


8.322 X 10-^ 






TABLE IL Numerical constants 6or and 62r in ea.(|ll|). 






bor 


&2r 


1 






75 
896 


2 




825 
1024 


125 
1536 


3 




25 
256 
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TABLE III: The numerical constants for the macroscopic quantities: the precise values for infor- 
mation theory, the 7th Sonine approximation values for hard-core molecules and the exact values 
for Maxwell molecules. 





\xx 
Ap 








As 


information theory 


12 
25 


6 

25 


6 

25 


3 
25 


1 

5 


hard-core molecules 


-4.600 X 10-2 


2.300 X 10-2 


-2.300 X 10-2 


' 1.150 X 10-2 


-2.035 X 10-^ 


Maxwell molecules 
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